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■ Abstract 

The sampling, quantization, and estimation of a bounded dynamic-range bandlimited signal affected by additive independent 
Gaussian noise is studied in this work. For bandlimited signals, the distortion due to additive independent Gaussian noise can 
be reduced by oversampling (statistical diversity). The pointwise expected mean-squared error is used as a distortion metric for 
signal estimate in this work. Two extreme scenarios of quantizer precision are considered: (i) infinite precision (real scalars); 
and (ii) one-bit quantization (sign information). If N is the oversampling ratio with respect to the Nyquist rate, then the optimal 
law for distortion is 0(1/N). We show that a distortion of 0(1/N) can be achieved irrespective of the quantizer precision by 
considering the above-mentioned two extreme scenarios of quantization. Thus, a quantization precision indifference principle is 
qq ■ discovered, where the reconstruction distortion law, up to a proportionality constant, is unaffected by quantizer's accuracy. 

(N 
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bandlimited signals, sampling, estimation, quantization 

^ ■ I. Introduction 

Consider a bandlimited signal (or field) quantization problem, where the samples are affected by additive independent and 
identically distributed (i.i.d.) Gaussian noise. For example, a spatial signal affected by additive i.i.d. Gaussian noise has to be 

■ sampled using an array of sensors. In a distributed setup, where filtering before sampling is not possible, noise in bandlimited 
00 ! signals can be reduced by statistical averaging of independent noisy samples. In addition, quantization error can be reduced by 
0^ ■ oversampling as well as by increasing the analog-to-digital converter (ADC) or quantizer precision. The fundamental tradeoff 

\ between oversampling, quantizer precision, and (statistical) average distortion is of interest. 

The tradeoffs between all subsets of these three quantities has been studied in the literature. Tradeoffs for average distortion 
and oversampling, additive Gaussian noise and average distortion with unquantized samples, and oversampling and quantization 
have a flurry of work (e.g., see (T), 12, (3), J4], J5]). In this work, the tradeoff between oversampling, quantizer precision, 
and the average distortion is of interest. 
• • ■ If extremely high-precision ADCs are used, then the sample distortion is noise limited. On the other hand, if lowest precision 
. £h ■ single-bit ADCs are used, then the sample distortion is limited by quantization. At a high-level, it is expected that the distortion 
optimal ADC precision should be 'in between' these two extreme cases, in the sense that it should be able to resolve the 
!-h \ signal up to the noise level. Contrary to this intuition, in this work it is shown that a distortion inversely proportional to the 
oversampling above the Nyquist rate is achievable with single-bit quantizers. With unquantized (infinite precision) samples, 
the optimal distortion is speculated to be inversely proportional to the oversampling above the Nyquist rate in the presence of 
independent Gaussian noise. Accordingly, the focus of this work is on the quantization of an additive independent Gaussian 
noise affected bandlimited signal using single-bit ADCs and oversampling. The key result of this paper is the uncovering of 
a quantization precision indifference principle, which is stated next. 

Precision indifference principle: Consider a bounded-dynamic range bandlimited signal with samples affected by additive 
independent Gaussian noise and observed through quantizers. If N is the oversampling ratio, with respect to the Nyquist rate, 
then the optimal law for maximum pointwise mean-squared error is 0(1/N), irrespective of the quantizer precision. In other 
words, for large N, the quantizer precision only affects the proportionality constant of the distortion. 

Prior art: Averaging and other properties of independent random variables are well studied in statistics |6|. Quantization 
error can be reduced by oversampling as well as by increasing the ADC (quantizer) precision (see |3), 0, ||4), for the 
entire range of results). Estimation of square-integrable signals in the presence of Gaussian noise was studied by Pinsker 0; 
however, quantization is not addressed in his work. Signal quantization with additive noise as a dither has been studied by 
Masry (8J, however signal was not assumed to be bandlimited. Masry's results give a decay of 0(l/iV 2 / 3 ) for bandlimited 
signals, where N is the oversampling above the Nyquist rate; this decay is slower than an 0(1/ N) decay that we are after. 
The sampling of signals defined on a finite support, while using single-bit quantizers in the presence of ambient noise, has 
been also studied 0, ifTUl . 
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Notation: The set of bounded signals and the set of finite energy signals will be denoted by £°°(R) and £ 2 (R), respectively. 
The signal of interest will be denoted by g(t). For a signal s(t) in £ 2 (M), the Fourier transform will be denoted by s(lj). The 
Fourier transform and its inverse are defined as, 

s(uj) = I s(t) exp(— jcjt)dt; s(t) = — j s(u>) cxp(jujt)duj. 

The indicator function of a set A is denoted by l(x <G A). Random variables or processes will be denoted by uppercase letters. 
The additive independent Gaussian noise is denoted by W{i). The set of reals and integers will be denoted by R and Z, 
respectively. The cumulative distribution function (cdf) of a Gaussian random variable with mean zero and variance a 2 will be 
denoted by F(x), x € R. The convolution and expectation operation will be denoted by * and E, respectively. It is assumed that 
all probability models have an underlying sample space, sigma-field, and probability measure such that (weighted) averages 
and indicator functions are measurable. 

Organization: The mathematical formulation of our sampling problem is discussed in Sec. [II] Short review of stable 
interpolation kernels and smoothness properties of associated signals are discussed in Sec. Hn] The discussion on precision 
indifference principle appears in Sec. [IV] Estimation with perfect samples and single-bit quantized samples are discussed in 
Sec. IIV-AI and Sec. IIV-BI respectively. Conclusions are presented in Sec. [V] To maintain the flow of the paper, long proofs 
appear in the Appendix. 



II. Problem formulation 

The discussion begins with a quick review of a stable bandlimited kernel, which is essential for stable interpolation in 
£°°(R) and for defining bandlimited signals. For A > 1 and a = (A — l)/2, consider the kernel <p(i) that is given by 
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sin((7r + a)t)sin(at); 0(0) = ! + -. 



(1) 



The kernel decreases sufficiently fast (approximately as l/t 2 ) and therefore it is absolutely and square integrable. Its Fourier 
transform is illustrated in Fig. Q] This kernel can be used to define the set of bounded bandlimited signals, which is a subset 
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Fig. 1. Stable interpolation filter: The kernel 4>(t) «-> 
bounded bandlimited signals. 



j) is defined in 01*.' this kernel is absolutely integrable and will be used to define 



of the Zakai class of bandlimited signals 1111 . Consider 



BL int := {g(t) : \g(t)\ < 1 and g{t)*<t>{t) = g(t) V< e R}. 



(2) 



The above definition ensures that g(t) is continuous everywhere. It is easy to verify that the set of bounded bandlimited signals 
in £ 2 (R) with Fourier spectrum zero outside [— tt, k] also belongs to the set BL m . The set BL ml also includes (almost-surely) 
any sample path of a bounded-dynamic range bandlimited wide-sense stationary process JT2]. The quantization of bandlimited 
signals from the set BL mt in the presence of additive independent Gaussian noise is studied in this work. The derived results are 
applicable to finite energy bounded bandlimited signals as well as (almost surely) to any sample path of a bounded wide-sense 
stationary bandlimited process. 

The signal affected by additive noise, g(t) + W(t), is available for sampling. It is assumed that W(t) ~ A/"(0, a 2 ) for all 
i6lR. Independence of noise implies that W(ti), W(i 2 ), ■ • ■ , W(t n ) for distinct t\, . . . , t„ G K are i.i.d. with J\f(0, a 2 ) 
distribution. The Nyquist rate at which g(t) should be sampled for perfect reconstruction is one sample/second. In the noise-free 
regime, when a = 0, it is sufficient to sample g(t) at the Nyquist rate for convergence in £°°(R). In the noise-limited regime, 
when a > 0, the reconstruction based on samples of g(t) will have distortion (statistical mean-squared error). This distortion 
can be reduced by oversampling. Let N, a positive integer, be the oversampling rate. For any statistical estimate G rec (t) of 
the signal g(t), the maximum pointwise mean-squared error D rec is defined as the distortion, i.e., 
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Grec(t)- 5 (t) 



(3) 



For a pointwise-consistent reconstruction, the distortion in (01 should decrease to zero as the oversampling rate increases 
to infinity J6). Consistent reconstruction of smooth signals with a random dither, in the presence of single-bit quantizers, 
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has been obtained in the past [8] ; therefore, the asymptotic rate of decrease in Z? rec with N is of interest to us. Due to 
finite precision limitations (ADC operation) during acquisition, the signal samples are quantized. Since quantization is a lossy 
operation |T3l , D lec is expected to depend upon the ADC precision employed. As mentioned in Sec. [I] it will be shown that 
D rec decreases as 0(1/N), irrespective of the sensor precision. Thus, the ADC precision only manifests in the proportionality 
constant (independent of the oversampling factor N) in the optimal asymptotic reconstruction distortion. 

To show the proposed precision indifference principle, two extreme cases of quantizer precision will be analyzed and their 
distortion will be compared: (i) signal distortion with perfect samples; and (ii) signal distortion with samples quantized using 
single-bit ADCs. The sampling setup for these two cases are illustrated in Fig. [2] In Fig. |2ja), the estimator works with infinite 
precision (unquantized) noisy samples while in Fig. |2jb), the estimator works with poorest precision (one-bit) noisy samples. 
The role of extra dither noise Wd(t) will be explained later in Sec. IIV-BI The estimator Gi-bit(i) will be designed and its 
distortion performance will be analyzed in this work. 

T = 1/(XN) 




(a) 



T = l/(XN) 




l(x > 0) 


lX(nr)} 


estimator 





W(t)\ \W d {t) 



(b) 



Fig. 2. Two extreme scenarios of quantization: In both the scenarios the signal g(t) is observed with additive independent Gaussian noise 
W(t). In (a), the estimator works with infinite precision (unquantized) samples {Y(nT),n £ Z}. In (b), the estimator works with poorest 
precision (one-bit) samples {X(n),n £ Z} where X(nr) — l(F(nr) > 0). 



Before we move on to the next section, it should be noted that the kernel <fi(t) and its derivative 4>'(t) are absolutely 
integrable. This absolute integrability and square integrability of cf>(t) can be translated into the following observations, which 
will be useful in Sec. IIV-B] during distortion analysis: 
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< oo. 



(4) 
(5) 

(6) 



The next section will review pertinent mathematical results which will be used in the later sections. 



III. Background 

The stable interpolation formula for Zakai sense bandlimited signals is discussd first. The necessity of Wd and associated 
variance-conditions on Gaussian noise (see Fig. |2{b)) are discussed. If the pointwise error in interpolation is bounded with 
bounded perturbation of samples, it is called as a stable interpolation. The properties of stable interpolation and its implications 
on filtering of bounded signals are given at the end of this section. 

^From the interpolation formula for Zakai sense bandlimited signals, the signal of interest g(t) can be perfectly reconstructed 
from its samples taken at the Nyquist rate. For g(t) G BL mt , the interpolation formula is given by 15] Lemma 3.1], 

fl(*) = *E'(iM*-?)- (7) 

nGZ 

where the equality holds absolutely, pointwise, and in £°°(R). Thus, in the absence of noise, it is sufficient to sample g(t) at 
a rate of A sample per second (or per meter in the context of spatial fields). In the presence of quantization, the reconstruction 
in is stable in £°°(R). 

The role of Wd(t) in Fig. |2jb) will now be highlighted. If the noise variance a is very small compared to the dynamic range 
of the signal g(t), i.e., |u| -c 1, then the samples l(g(t) + Wit) > 0) will not capture small scale local variation in g(t). Due 
to quantization, estimators such as maximum likelihood are expected to be non-linear and their analysis is too complex. To 
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alleviate this issue, if var( W(t)) = a 2 is very small, then an extra additive independent Gaussian dither Wd(t) can be added 
to ensure that l(g(t) + W(t) + Wd(t) > 0) is sufficiently random. It is assumed that Wd(t) and Wit) are independent. Such 
dithering allows us to use an analytically tractable reconstruction procedure, which has order-optimal distortion. The block- 
diagram for sampling with one-bit ADCs is illustrated in Fig. [2b). The technical condition on a 1 = var(W(t)) + var(Wd(t)) 
is stated using the cdf of W + Wd- Let F : R — s- [0, 1] be the cdf of W + Wd- Let f(x) be the associated probability density 
function with /(iC^) = <5 and /(0) = A. Observe that A > S, since f(x) — -j=^ cxp(— x 2 /2a 2 ). It is required that there 



where is the constant in ©. First fix a A > 1. Then, = / R \§(t)\dt > J t R <p(t)dt = 0(0) = 1. That is, C 2 %/2 > y/2 > 
1. Therefore, the lower bound on p, in ([8]) is positive. Next, observe that if a is large but fixed, then 5 = /(C^) w /(0) = A. 
Then 6 and A are close enough and the inequality in (H) can be satisfied. In other words, for a fixed A and hence C^, there 
is a finite number cto for which ^ is satisfied for all a > ctq. If var (W(t)) < a 2 , then \ar(Wd(t)) > a 2 — \ar(W(t)) will 
ensure that var(W + Wd) > ctq- ^ var(W(t)) > (Tq, then the extra dither is not needed. This condition will be used in the 
distortion analysis in Sec. IIV-BI 

For single-bit estimation, the signal F(g(t)) — 1/2 will be encountered, where F : R — >• [0, 1] is the cumulative distribution 
function of the stationary noise random variable W(t) + Wd(t). Since g(t) £ [—1, 1], and F(x) has a wider support than the 
dynamic range of signal (i.e., [—1, 1]), therefore F'(x) is finite and non-zero for x E [—1, 1]. Since F(0) = 1/2 by symmetry, 
therefore, F(g(t)) — 1/2 is more convenient than F(g(t)) to work with. For simplicity of notation, let lit) = F(g(t)) — 1/2. 
Then \l(t)\ < |-F(1)| — 1/2, i.e., l(t) is bounded. The bound depends only on the noise distribution and the dynamic range 
of g{t). Finally \l'(t)\ = \F'(g(t))g' (t)\ < |F'(0)2tt 2 | since F'(0) maximizes F'{x) in [-1,1] and \g'(t)\ < 2ir 2 (see 
Proposition 3.1]). 

The definition of BL[ nt involves convolution with a stable kernel and convolution will often appear in the context of error 
analysis. The following short lemma will be quite useful later on. 

Lemma 3.1: Let p(t) be a signal such that ||p||oo is finite and P(t) be any random process such that P{t) is bounded (i.e., 
sup teR E(P 2 (<)) is finite). Then, 



is a parameter fi > such that 




(8) 




(9) 
(10) 



where the convolutions are well defined since <fi(t) is absolutely integrable. 

Proof: The proof follows by the definition of convolution and the triangle inequality. We have 




oo • 



For the second moment bound, note that 



E(||P(£)|*|<X*)|| 2 ) 





u)\W 



v)\dudv, 




= C 



' 2 supE(P 2 (*)), 



where (a) follows by E(2|P(u)||P(v)|) < E(P 2 (u) + P 2 {v)) < 2sup t E(P 2 (i)). Thus the proof is complete. ■ 
The two extreme scenarios of quantization as depicted in Fig. [2] and their distortions will now be analyzed in the next 
section. 
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IV. Estimation of bandlimited signal 

Interpolation of bandlimited signals with perfect samples is a well known topic [1 1. Loosely speaking, a bandlimited signal 
of duration T and bandwidth tt has 2nT degrees of freedom lfl4l . With NT noisy samples of the field g(t) + W(t) in duration 
T, the optimal distortion is expected to be 0(1/7V)Q With this note, sampling schemes with oversampling rate N are designed 
to achieve a distortion of 0(1 /N) for sampling g(t). 



A. Estimation with perfect samples 

A brief review of estimation with perfect samples will be highlighted first. Optimal minimum mean-squared method can be 
found in the work of Pinsker Q. For illustration and to get a distortion proportional to 0(1/ N), it suffices to use the frame 
expansion. Let the integer-valued oversampling ratio (above the Nyquist rate) be 2V, and r = 1/(\N). Then, the samples 
{Y(nT),n e Z} are available for the reconstruction of g(t). Using frame expansion or the shift-invariance of bandlimited 
signals, 



9 ^> = JjYI ^9(nr)(j}(t - nr), 



TV 

where the equality holds pointwise and in £°°(R). It must be noted that the basic operation in ( fTTT ) is that of averaging; hence, 
the noise is expected to average out while the signal will be retained. This intuition motivates the following estimator for g(t) 
from noisy data (see Fig. |2a)). Define 

:= Jf Yl AF(nT)0(f - nr), (12) 

i=o fcez \ / \ / 

The distortion of Gf r (i) is given by the following proposition. 

Proposition 4.1 (Frame estimate with 0(1 /N) distortion): Let Gfr(t) in (fT2l be an estimate for the bandlimited field g(t) 
corrupted by additive independent Gaussian noise. Let Df r (t) := E|Gf r (i) — g(t)\ 2 . Then, 

C" A 2 a 2 

supD fr (i) < - (13) 

t<ER JV 

where the constants a 1 an d C'^ from (|6]l do not depend on N . 

Proof: See Appendix IVI-AI ■ 
The signal term in ( fT2l converges in £°°(M) to g(t). The noise term results in an independent sum of zero-mean random 
variables at every ( £ 1. This sum of random variables has a variance that decreases as (1/N) due to the finite energy of 
the interpolation kernel <f>(t). The constant C'l depends on the properties of the kernel 4>(t). The estimation with single-bit 
quantizers and associated distortion analysis will be presented next. 



B. Estimation with single-bit quantized samples 

This section will present the key result of this work. Consider the system illustrated in Fig.|2jb). In this section, a G\.^i t (t) 
will be obtained such that -Di_t>it scales as 0(1/ N). This is non-trivial to achieve because the non-linear quantization operation 
is coupled with the statistical estimation procedure. The result will be established in two parts: (i) it will be shown that suitable 
interpolation of one-bit samples converges to a non-linear one-to-one function of g(t) with an error term having a pointwise 
variance of 0(1/ N); and (ii) the obtained non-linear function of g(t) can be inverted in a stable manner using recursive 
computation based on contraction-mapping. It will be assumed that vai(Wd(t)) = (a 2 — vm(W(t))) + , where a is such that 
dS) is satisfied. 

The stability property of kernel <p(t) has been discussed Sec. [Til] For this section, fix r = 1/(NX), where A > 1 is an 
arbitrary stability constant. Analogous to ( fTTT i. consider the random process obtained from the single-bit samples X(nT),n E Z, 

H N (t)=T^(X(riT)-l/2)(j)(t-nT). (14) 
Then, the following proposition establishes the convergence of H^(t) to a function of the signal of interest g(t). 

'A single bounded constant in additive independent Gaussian noise with N independent readings can be estimated up to a distortion of 0(1/N) (§)■ 
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Proposition 4.2 (Convergence of single-bit interpolation): Let l(t) = (F(g(t)) — 1/2) and -ffjv(t) be as defined in 0141) , 
Then 

sup - «(*)*<K*)) 2 < % + % (15) 

where C-2 > and C3 > are constants independent of N. 

Proof: See Appendix IVLBl ■ 

The factor r = 1/(XN) provides the normalization for averaging in (14\ . while the terms (X(tit) — l/2)<fi(t — nr) are 
weighted independent one-bit samples. The average in (fl3T l converges in mean-square to a convolution. The signal l(t) E £°°(R) 
and the limit l(t) *</>(i) is a lowpass version of l(t). The dependence of l(t) *<f>(t) on is non-linear due to quantization, 
which results in the F(g(t)) term. The original signal g(t) is Zakai sense bandlimited and it has one degree of freedom per 
unit time. The degree of freedom per unit time of l(t) * <j>(t) can be up to one as well, and F(x) has 'nice' properties as a 
function. Thus, it is not unreasonable to expect that there might be a class of F(x) such that (F(g(t)) — l/2)*0(t) can be 
inverted to find g(t), even though this equation is nonlinear. 

Consider compandors defined by Landau and Miranker lfl31 . 

Definition 4.1: lfl5l pg 100] A compandor is a monotonic function Q(x) which has the property that Q(m(t)) £ £ 2 (K) if 
m(t) e C 2 (R). 

Landau and Miranker have shown that if g(t) E £ 2 (R) and g(to) is zero outside [— tt, tt], and if Q : [— 1, 1] — >• M is a compandor 
with non-zero slope, then there is one to one correspondence between g(t) and Q(g(t)) ★sinc(t) lfT31 . Further, given any signal 
m(t) <G £ 2 (M) and m(w) zero outside [— tt, tt], there exists a unique g m (t) <G £ 2 (R) with g~ m (ui) zero outside [— tt, tt] and 
Q(g m (t)) *sinc(i) = m(t). 

In our case, c?(£) need not be in £ 2 (R), even though l(t) = F(g(t)) — 1/2 is a compandor. Thus, the procedure of Landau 
and Miranker does not extend directly to bandlimited signals in £°°(R), especially in the presence of statistical perturbations. 
Suitable modifications of their approach will be used to obtain the results for our problem. 

The dependence between g(t) and l(t) * (f>(t) is quite non-linear. There is no clear or obvious equation by which g(t) can 
be obtained from l(t) * 4>(t). Therefore, this inversion problem is casted into a recursive setup, where Banach's fixed-point 
theorem can be leveraged along with contraction mapping |[T6l Ch. 5]. This approach is inspired from the work of Landau 
and Miranker. Their recursive setup is noted to be stable to perturbations of g{t) in £ 2 (R) |[15l . This work will use a variant 
of their procedure, since the perturbation due to statistical noise with finite variance is not in £ 2 (R). Therefore, our recursive 
procedure to obtain an estimate of g(t) from Hiy(t) (see (fl3] l) and its analysis is non-trivial and it will be presented in detail. 

In summary, an estimate for g(t) is required. Due to quantization and noise, which is a non-linear operation, an approximation 
His[{t) of (F(g(t)) — l/2)*0(f) is available. The estimate Hpf(t), which converges to (F(g(t)) — l/2)*</>(i) with sample density 
N j" 00, will be inverted to obtain an estimate Gi_b[ t (t) for the signal g(t). To establish the precision indifference principle, 
we wish to show that the mean-square error sup t6R E|(?i_bj t (i) — g{t)\ 2 decreases as 0(1 /N). The details are presented next. 

A 'clip to one' function Clipfa;] is defined first. 

Clip [a] = x if \x\ < 1 

= sgn(x) otherwise. (16) 

Since g(t) has a dynamic range bounded by one, by assumption, it will be unaffected by clipping. Note that under the C°° norm, 
this transformation reduces the distance between any two scalars x\ and X2, i.e., |Clip[xi] — Clip[x2]| < \x\ — x^\. This can be 
verified on a case by case basis. For example, if x\ > 1 and x% E [—1, 1], then |Clip[xi] — Clip [12] | = |1 — 22] < \%i — ^2|- 
Other cases can be similarly enumerated. This clipping procedure is non-linear and complicates some of the presented analysis; 
however, we feel that its presence is essential for analysis. 

Let i/j(t) = (j>(Xt). Then ip(uj) = <f>(u>/\). Thus, ip(uj) is flat in [— Xtt, Xtt] and in ±[Att, X 2 tt] decreases linearly to zero. 
Consider the set of bandlimited signals defined by, 

5 BL .bdd = {m(t) : \m(t)\ < and m(t) * V(*) = m(t)}. (17) 

Then, £>BL,bdd ^ s a com pl ete subset of the Banach space C°°(M.). 

Lemma 4.1 (S^rbdd i s a complete metric space): Let iSjjL.bdd ^> e as defined in ( 117b . Then (<!>BL.bdd! 1 1 - 1 1 00 ) is a complete 
subset of (//^(IltlJI.Iloo). 

Proof: Define the distance function d : 6>BL,bdd x ^BL.bdd ~ ^ K + as d(mi,m2) = ||wi — m2||oo with mi(t),m,2(t) € 
^BL,bdd- It is easy to verify the axioms of distance metric ifTBI : (i) d > and d < 00; (ii) d(m,\,m,q) = if and only if 

m\(t) = rri2(t); (iii) d(mi, m^) — d(rri2, mi); and (iv) d(m\, m^) < d(wi\, 1713) + d(m^, 7722) for any m\(t), m2(t), rri2,(i) € 
^BL.bdd- 

It is straightforward to see that SaL.bdd since HmHoo < C<j, for every m(t) E ^BL.bdd- To show that the subset 

is complete, consider any Cauchy sequence m n (t) <G <S>BL,bdd- ^ mce £°°(K) is complete, therefore m n (t) —> s(t), where 
s(t) G £°°(R). It remains to show that s(t) belongs to ^BL.bdd- 
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For any e > 0, there is an no such that \\m n — s\\oo < e for all n > uq. Since J R \ tp(t)\dt = C^/X, therefore, \\m n * 
t/j — s * ip\\oo < H m n — s \\(C<f>/X) — C^e/X for all n > uq (see Lemma [XTT i. Thus, m n (t) * tp(t) s(i)*i/j(i). However, 
m n (t) *i/)(t) = m n (t) since m n (t) e SBL.bdd- Therefore, it follows that s(t) = s(t) -kip(t), or s(t) € iSBL,bdd- Thus, <SBL,bdd 
is complete. ■ 

A map T : ^BL.bdd — ^ ^>BL,bdd w iH be defined next. This map will result in a recursive procedure to obtain g(t) from 
h(t) := l{t)*(j)(t).' Define 

T[m(t)} = ClipL/i(i) + [m(t) - p(F(m(t)) - 1/2)] *<£(*)] *0(t). (18) 

It will be shown that T is a contraction on (iSfiL.bddi 1 1 -I loo)- 

Lemma 4.2 (T is a contraction): Let (SBL,bddi 1 1 - 1 1 oo ) be the metric space as defined in (T7\ . Let T : 5BL,bdd — > ^BL,bdd 
be a map as defined in ( fT8l . If the condition in ^ is satisfied, then there is a choice of p such that T is a contraction, i.e., 

||T[toi] - T[m 2 ]||oc < a\\mi - m 2 ||oo> (19) 

for some < a < 1 and any m\(t), m 2 (i) € ^BL.bdd- The parameter a does not depend on the choice of m\ and m-i- 

Proof: See Appendix IVLCl ■ 
Now the key recursive equation will be stated. Let l(t) = (F(g(t)) — 1/2) and h(t) = l(t) *<fr(t) be available for obtaining 
g(t). Then, 

g k+1 (t) := T[ff fc (t)] = Oip[ph(t) + ^(t) - p(F(g k (t)) - l/2)]*0(t)] *#t), (20) 

where fc > 0, fc £ Z and u > is a constant that will be chosen according to Lemma 1431 Set go(t) = 0. The original signal 
g(t) is a fixed point of this equation and it can be verified by substitution. The following proposition shows that g(t) is the 
only fixed point of the equation in d20b . The proof hinges on Banach's fixed point theorem or contraction theorem fl6l Ch. 5]. 

Proposition 4.3 (Signal of interest is the fixed point ofT): Let g(t) E BL mt C £>BL,bdd ^ e a continuous bounded bandlim- 
ited signal. Let h(t) = l{f) * <j)(t), where l(t) = F(g(t)) — 1/2. Consider the recursion gk(t) — T[g k -\(t)], where T is as 
defined in ( fT8l ). Set go(t) = 0. If p is selected as in ©, then 

lim \\g k - gWoo = 0. (21) 

k— too 

Proof: The proof is straightforward with Lemma |4~T1 and Lemma l4~2l in place. Define d(mi,m2) = — 7712 1 |oo f° r 
any toi (f) , m 2 (t) G ^BL.bdd- From Lemma |4~T1 note that (^BL.bddjGO i s a complete metric space. The signal g(t) is in £>BL,bdd 
and it satisfies g(t) = T[g(t)], i.e., it is a fixed point for T defined in ( TT8b . 

Pick p as in {8). Then T is a contraction on (6>BL,bdd7 Thus, by Banach's fixed point theorem (contraction theorem) Ifl6l 
Ch. 5], there is exactly one fixed point in 6>BL,bdd ^ or tne ec l ua ti on .<?(/) = T[g(t)]. Since g k (t) converges to a fixed point, it 
must converge to g(t) in the distance metric d. Thus the proof is complete. ■ 

Propostion 14.31 holds with perfect information about l(t) * 4>(t). The estimation of signal from ifjy(t), the statistical 
approximation of l(t) * 4>(t), will be discussed now. Let G k (t) be the sequence of random waveforms generated from Hpf(t) 
when it is applied to the recursion in (l20l i. That is, fix Go(t) = and define 

G k+1 (t) :=T[G k (t)} = Oip[pH N (t) + [G k (t) -p(F(G k (t))- 1/2)} *<j>(t)\ *<f>(t). (22) 

Let Gi-bit(0 = limfc^oo Gfc(t)0 For the same choice of \x which ensures that T is a contraction on ((SgLbdd) ll-l|oo)> the 
distortion of |Gi_bit(i) — g(t)\ has to be established. To this end, the following proposition is noted. 

Proposition 4.4 (1-bit estimation has distortion 0(1/N)): Let i?jv(i) be the estimate of l(t) as described in (TBI and u be 
selected as in ©. With Go(t) = 0, let Gfc(i) be the sequence of random waveforms as defined in (l22l . Define linu—^oo Gk{t) = 
Gi-bit(i)- Then, 

DLbit := supECGLbit^) - 5 (t)) 2 = 0(1/JV), 

i.e., the distortion -Di-bit decreases as 0(1/N). 

Proof: See Appendix IVLDl ■ 
The results of Proposition 14.11 and Proposition 14.41 can be summarized into the following theorem. 

Theorem 4.1 (Precision indifference principle): Let g(t) be a bounded dynamic- range bandlimited- signal as defined in (0. 
Assume that g(t) + W(t) is available for sampling, where W(t) an additive independent Gaussian random process with finite 

2 This limit exists since it can be shown that ||Gfe — Gfc_i[[oo < «||Gfe_i — Gfe_2||oo for some < a < 1 by using an analogous procedure as in 
Lemma 14.21 
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variance. Fix an over sampling factor of N, where N is large for statistical averaging. There exists an estimate G]_t,t t (t) 
obtained from single-bit samples of g(t) + W(t) such that 

supE\d 14rit (t)-g(t)\ 2 =0(l/N). 

This distortion is proportional to the best possible distortion of 0(1/N) that can be obtained with unquantized or perfect 
samples. 

A few remarks highlighting the importance of the results obtained will conclude this section. 

C. Remarks on the results obtained 

1) Comparison with the bit-conservation principle: The bit-conservation principle [5 | is somewhat in contrast to the precision 
indifference principle. Loosely speaking, bit-conservation principle states that for sampling a bandlimited signal in a noiseless 
setting, the oversampling density can be traded-off against ADC precision while maintaining a fixed bit-rate per Nyquist interval 
and an order-optimal pointwise distortion. In the presence of additive independent Gaussian noise, this tradeoff between ADC 
precision and oversampling is absent while studying pointwise mean-squared distortion. In the noisy setup, the distortion is 
proportional to 1/N, where N is the oversampling density irregardless of the ADC precision. The presence of noise shifts the 
role of ADC precision towards only the proportionality constant in distortion! 

2) Interpretation of precision-indifference principle: First, it can be argued that the precision indifference principle holds 
while estimating a constant signal (one degree of freedom) in additive independent Gaussian noise. Assume that a constant 
c G [—1, 1] has to be estimated based on N noisy readings Y{ = c+Wi, 1 < i < N, where {Wi, 1 < i < N} are i.i.d. Af(0, a 2 ). 
In the absence of quantization, Cjy = (2~2iLi Yi)/N converges to c in the mean-square sense, and E(Cjv — c) 2 = a 2 /N. This 
is the optimal distortion if perfect (unquantized) samples are available. Now consider the case where single-bit readings 
Bi = l(c + Wi > 0), 1 < i < N are available. The random variables {B h l<i< N}jue i.i.d. Ber(g) where q = P(W > 
-c) = P(W < c) = F(c). Assume B N = (T,?=i B i) / N ■ lt can be shown th at ®(B~n - F(c)) 2 < l/(4iV) since each 
var(S,) < F(c)(l - F(c)) < 1/4. Define tVbit = F~ 1 (B N ) if B N G [F(-l), F(l)] and Ci_bit = ±1 otherwise. Since F(x) 
is invertible and dF~ 1 (x)/dx is bounded for x G [F(—1),F(1)], therefore, using the delta method, Ci_bit obtained from Bm 
has a mean-squared error which decreases as (1/N) J6). Next, it should be noted that bandlimited signals have one degree of 
freedom in every Nyquist interval. An oversampling factor of N means that there are N samples to observe each degree of 
freedom on an average. Finally, observing the Nyquist samples of a bandlimited signals with a distortion of 0(1 /N) results, 
by stable interpolation with kernel <fr(t), in a pointwise distortion of 0(1/ N) for the signal estimate at any point. 

3) Precision-indifference for a larger class of noise: Consider the model where each sample Y(nr) = g(nr) + V(nr) is 
affected by some non-Gaussian noise. Focus on the case where V(nr) can be written as V(nr) = W(nr) + U(nr), where 
W(nr) and U(nr) are i.i.d. for all n G Z, r G K. If W(nr) is Gaussian, var(V(nr)) = a 2 < oo, and Fy(x) satisfies (|8), 
then the precision indifference principle will hold. The extension of existing proofs is simple and only its key steps will be 
mentioned here. In the perfect sample case (see Fig. EJa)), the Gaussian part of V(t) will limit the best possible (optimal) 
distortion to 0(1/ N); this is because even if the values of U(nr) are (magically) known the residual W(nr) will limit the 
distortion. With single-bit quantization, note that all the proofs in Sec. IIV-BI only depend upon the existence of a S and A 
such that (0 is satisfied, monotonicity of Fy(x) such that its derivative is bounded away from zero, and Fy(0) = 1/2. The 
recursive procedure in d20t . however, requires the knowledge of Fy(x). 

V. Conclusions and future work 

The sampling, quantization, and estimation of a bounded dynamic-range bandlimited signal affected by additive independent 
Gaussian noise was studied. Such setup naturally arises in distributed sampling or where the sampling device itself is noisy. 
For bandlimited signals, the distortion due to additive independent Gaussian noise can be reduced by oversampling (statistical 
diversity). The maximum pointwise expected mean-squared error (statistical C 2 error) was used as a distortion metric. Using two 
extreme scenarios of quantizer precision, namely infinite precision and single-bit precision, a quantizer precision indifference 
principle was illustrated. It was shown that the optimal law for distortion is 0(1/ N), where N is the oversampling ratio with 
respect to the Nyquist rate. This scaling of distortion is unaffected by the quantizer precision, which is the key message of the 
precision indifference principle. In other words, the reconstruction distortion law, up to a proportionality constant, is unaffected 
by quantizer precision. 

Extensions of the precision indifference principle to other classes of parametric or non-parametric signals is of immediate 
interest. Further, this work assumed sufficient dithering by noise because the estimators were linear. It is of interest to look 
towards estimation techniques which do not require extra dithering. 
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VI. Appendix 
A. Unquantized samples result in a distortion of 0{1/N) 
By using ([Til l and the definition of Gf T (t), first note that, 

GfrW-sW^f^E^fy + zrWi-- 



i=0 kel 



Since W(k + it) are i.i.d. with variance a 2 , therefore, 



N-l 



E|G fr (i) - g(t)f 



From ©, £ fce z \4>(t - |)| 2 < C'L Thus, 



The proof is now complete. 



EE AV 



i=o kel 



X NX 



k i \ 
t ~X ~N~XJ 



E\G fl (t) - g(t)\ 2 < 



C'LX 2 o 2 



N 



(23) 



B. Estimation of non-linear function of the signal g(t) 

By the linearity of expectation, it is easy to see that E(JJjv(i)) = r Snez l( nT )<t l (* — For variance calculations, note 
that each X(nr) is an indicator random variable. Thus, var(X(nr)) < (1/4). Using the independence of {X(n,T),n G Z}, 
we get 



var(ffjv(*)) 



T 2S jTv<x{X{nT))\nb{t~nT)Y 



< 



< 



T 

T 



N-l 

EE 

igZ i=0 



C'L 



9i 

7V : 



4A 2 /V 

where C'l is given by ([6j, and is finite since <f>(t) decays rapidly and is in £ 2 (M). The constant C2 := C^/(4A 2 ). 

Next it will be shown that as N — >• 00, the expression r X^nez F{9( nT )) ( t ) if ~ nT ) converges to the right hand side of ( fl5l l. 
The proof uses the fast decay of <f>(t), which ensures absolute integrability of <fi(t). Consider the expression 



eo 



l(u)(f>(t — u)du 



Tl(r)<f>(t - t). 



3 This summation is well defined since l(t) = (F(g(t)) — 1/2) is bounded and <j>(t) is integrable. 
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This expression represents the error in approximating convolution integral in a r interval by the corresponding term in a 
Riemann sum liTBl . This can be bounded as explained next, 



eo 



[l(u) - l{r)](j){t - u)du-l(r) 



T(f>(t — r) — / 4>{t — u)du 



< \\l'\ 



\4>(t - u)\du 



l(r) 



T<j){t — r) — / 4>(t — u)du 



(24) 



where we use the triangle inequality, \l(u) — 1(t)\ < ||£'||oo(tt — t), and finally \u — t\ < r. Next, by Lagrange mean-value 
theorem, we note that J Q (j>(t — u)du = T(f>(t — to) for some to £ (0, r). Thus, from (124) . 



icoi < imiooT- 

< II/'IUt 



\<f>(t - u)\du + ||i||ooT|0(t - r) - 0(i - t )[, 
|0(t-u)|dii+||?|| oo r 2 |0'(t-iio)|, 



for some uo £ (0, r). We note that \<f>(t — u) — <fi(t — to)\ = \<f>'(t — uo)\\u — to\ < for some uo £ (to, r) C (0, r) (this is by 
Lagrange's mean-value theorem). In the same fashion, for any [tit, (n + 1)t] interval, the following bound can be established: 

.(n+l)T 

|0(t-«)|d« +||l||ooTV («-«n)|, 



|e„| < Hi'Hoo 
where u n £ (nr, (n + l)r). Finally, 

|E(^(t))-/(t)*0(*)l 



(25) 



< 



r^/(nr)0(t 



l(u)<j>(t — u)du 



<Ei e «i' 

< ll/'ll 



|^(t-«)|dm-||J|| c 



lie: 



where the last step follows using ( f25l l. Using the boundedness of and (see (|4]i and (0), and using bounds for l(t) and 
we get, 

"^(O)(2tt 2 )C , |F(1)-1/2|C;\ l _ c 3 



\E(H N (t))-l(t)*4>(t))\ < 



X 2 



N N 



(26) 



Finally, 



E(H N (t) - 1(f) * 0(t)) 2 = vai(H N (t)) + [E(H N (t)) - l(t) * 0(t)] 2 



< 



as N — > oo. 



TV TV 2 

The upper bound in the above inequality is independent of t\ therefore, the desired result follows by maximizing the left hand 
side as a function of t. This completes the proof. It should be noted that the mean-squared error between H^(t) and l(t)-k<j)(t) 
is of the order of (1/N). This result will be used to find the mean-squared error of &i-bit(i) — g(t)- 

C. The map T is a contraction 
From dH), first note 



J_\ 1 



< 1 



Since F'(x), the pdf of the noise random variable, is positive and F' (x) £ [5, A] for x £ [— C$, C^], therefore, 

F( x ) — F(y) 

s < _W W < A for a; ^ j/ and a;, y e [-CL,, CJ. (27) 

Now consider the map in ( fT8l ). First, it will be shown that if m(t) £ <?BL,bdd> then T[m(t)} £ <SBL,bdd- Define, 

r(t) := iih(t) + [m(t) - li(F(m(t)) - 1/2)] * 4>(t). (28) 
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Then T[m(t)} = C\ip[r(t)]*tj>(t). Since |Clip[r(i)]| < 1. Lemmal3!lapplied with v(t) = Clip[r(i)] results in |Oip[r(*)]*0(*)| < 
C+ for all t G R. Next, T[m(i)] = (Clip[r(i)] *^(t) = Oip[r(i)] * * ip(t)) = Clip[r(t)]*4>(t) = T[m(t)\. 

Note that <j>(uj)ifj(uj) = </>(w) which results in <p(t) *tp(t) = 4>(t). That is, T[m(t)] satisfies the convolution property needed to 
be present in the set 6>BL,bdd- 

The contraction property will now be established. Let m\{t) and 777,2 (i) be any two signals in SBL,bdd w i m corresponding 
ri(t) and r 2 (t) as defined in d28l l. The transformed signals can be written in terms of Ti(t) as T[rrii(t)} = Clip[7';(i)| * <fi(t) 
for i = 1, 2. The signals m\(t) and 7772(7;) are bounded in [— C^, C^\. The contraction property is established by the following 
steps: 



\n(t)-r 2 (t)\ 



m x {t) - m 2 (t) - y. (F(mi(t)) - F{m 2 {t)))] * <j>{t)\ 

F{ mi {u)) - F{m 2 {u)) 



K(u) - 777 2 (u)) 1 - /! 



(a) 
< 



(6) 
< 



\mi(u) - m 2 (w) I 



7T7i(u) — 7772(7*) 

F(mi(u)) - F(m 2 {u)) 



777l(u) — 7772(u) 



</)(t — u)du 
\4>{t - u)\du 



\m\(u) — 7772(77)1 11 — fiS\\(f>(t — u)\du 



(29) 



life! 



(c) 

< |1 - /i(5|||mi - m 2 | 

C'^l - /J<5| • ||777l - 7772||oo, 



\<j>(t - u)\6u 



where (a) follows by the triangle inequality, (b) follows from ( f27l > and /iA < 1, and (c) follows from the definition of the 
£°°-norm. Next, by using the distance-reduction property of the clip-to-one function, we get |Clip[r 1 (t)] — Clip[r 2 (i)]| < 
\n(t) - r 2 (t)\ < C$\l - fiS\ ■ \\m-t - malloo- Applying Lemma [XT] with p(t) = n(t) - r 2 (t), we get, 

\T[ mi (t)] ~ T[m 2 (t)]\ < C||l - fiS\ • H777! - malloo- 

By taking supremum on t in the left hand side of the above equation, the desired contraction can be obtained: 

||T[777l] - r[777 2 ]||oo < Cj\l ~ flS\ ■ ||tBi - 777 2 ||oo, (30) 

independent of the choice of mi(t),m 2 (t) £ <?BL,bdd- ^ ne conditions in © ensure that the parameter C?|l — fj,6\ < 1, Set 
a := C||l — fj,6\, where a < 1. Thus, 

\\T[mi] - r[m 2 ]||oo < a ■ \\m 1 - m 2 ||oo, 

for some < a < 1. Since C^, 6, and A do not depend on 7774 and 7772, therefore a is independent of the choice of 777,1 and 
777,2. Thus the proof is complete. 



D. Mean-squared error analysis of \G]„bj t (t) — g(t)\ using contraction 

To analyze the mean-squared error, two sets of recursion will be considered. One will involve H^(t), the statistical estimate 
of l(t) * 4>(t), and corresponding Gk(t). Then Gi_bit(i) is the limit of Gk(t) as k — > 00. The second recursion will involve 
h(t) = l(t) * 4>(t) and the corresponding estimate gk(t) for the bandlimited signal g(t). In the second recursion, g(t) is the 
limit of <?fc(t). Let rk(t) and Rk(t) be defined as follows: 



r fc (t)=/i/i(*)-[s*-i(*)-A*(^(Sfc-i(t))-l/2)]*^(t), 
R k (t) = nH N (t) - [Gk_i(t) - »(F(G k -i(t)) - 1/2)] * 4>{t). 



(31) 
(32) 



Note that g k (t) = Clip[r fc (i)] * </>(t) and G k (t) = C\ip[R k (t)} *4>(t). By subtracting (EB from d32j, the following equations 
are obtained: 



Rk(t) - r k (t) = ft(H N (t) - h(t)) - [G k -i(t) - g k -i(t) - fi(F(G k -i(t)) - F(g k -i(t))\ *<f>(t), 

= fi(H N (t) - h(t)) - [ <t>(t- u)\G k -i(u) - g k -i{u) - fx(F(G k -i(u)) - F(g k -i(u))) 
By applying the triangle inequality twice on the above equation, the following inequalities are obtained: 



du. 



\Rk(t)-r k (t)\<fi\H N (t)-h(t)\ + 
< n\H N (t) - h(t)\ + 



cb(t - u) Gk-i(u) - g k -x(u) - fx(F(G k -i(u)) - Fig^u))) 



du 



Mf-u)||G fc _i(u)-0fe_i(tO| 



F(G k -i(u)) - F(g k -i(u)) 



G k -i{u) - gk-x{u) 



du (33) 
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The use of ((SJ and ( f2Tb in ((33) results in 

\R k (t) - r k (t)\ < n\H N (t) - h(t)\ + |1 - ^| f \<f>(t - u)||Gfe_i(«) - g k -x{u)\&u. 
Since the clipping operation reduces distance, therefore 

\Oiv[R k (t)] - Oip[r fc (f)]| < n\H N (t) - h(t)\ + |1 - / |0C* - «)l|Gfc-i(«) - fl fc -i(«)|d«. 

= v\H N (t) - fc(t)| + |1 - pS] (|0(t)| * |G fc _i(f) - g k -i(t)\) . (34) 

Now the mean-squared error of Clip[i?fc(£)] — Clip[rfc(i)] will be bounded using fl34"l i. First note that for any two random 
variables X and Y, E((X + Y) 2 ) < 2E(X 2 + Y 2 ). Thus, taking second moments on both sides of (O results in 

E(|Clip[ii fc (*)] - C\i V [r k {t)]\ 2 ) < 2^ 2 E(\H N (t) - h(t)\) 2 + 2|1 - fiS\ 2 E ((|0(t)| * |G fc _i(t) - g k ~i(t)\) 2 ) , 



<2fi 2 E\H N (t) - h(t)\ 2 + 2|l-/x5| 2 



su P E|Gj^i(t) - g k -i{t)t 



Cl (35) 



where the last inequality follows from Lemma [3~T| with P(t) = G k -i(t) — g k -\(t). Taking supremum over t on the left side, 
the following recursive relationship is obtained: 

su P E(|Clip[i4(i)] -Clip[r fc (t)]|) 2 < 2 M 2 (-^ + ^+2C 2 \l-vS\ 2 supE(\G k - 1 (t)-g k - 1 (t)\) 2 , (36) 

where the uniform upper bound on E|if/v(i) — h(t)\ 2 from ( fT3T > has been used. Since G k (t) — g k (t) = (Clip[R k (t)] — 
Clip[r fc (i)]) *<£(*), by applying Lemma [3~T1 with P(i) = Clip[P fc (i)] - Clip[r fe (t)] we get, 

swpE(\G k (t) - g k (t)\) 2 < 2Cy + ^) + 2C t\ l ~ tf? supE(|Gfc_i(t) - g fc -i(t)|) 2 . (37) 

From ®, it is noted that \/2C||l - /x<5| < 1. Define < /3 := 2C| |1 - fi5\ 2 < 1. Using the recursion in ([37j, it follows that 



hm S upE| GfcW -. 9fc (^ < — 2C 2 , 2 I ^ + 08) 



Since we know that G k (t) and <7fc(t) converge in C°°(M) to Gi-bit(0 and g(t), respectively, therefore, 

su P E| Gl . bit(i ) -g{t)\* < ^2, 2 ( Jl_ + (39) 

Lastly, fj,, (3, C2, A, and C3 are constants that do not depend on N, therefore, 

supE|G 1 . bit (t)- 5 (t)| 2 = 0(l/iV). 
t 

The proportionality constant depends upon the class of signal 6>BL,bdd' me noise variance a 2 , the stability properties of <fi(t), and 
the chosen constant /i. It does not depend on the individual signal g(t). This completes the proof of the accuracy indifference 
principle. 



